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What is claimed is: 
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5 1 . A method for multiplexing data streams comprising the steps of: 
obtaining a first input data stream; 

obtaining first time stamp information for the first input data stream; 
obtainin^buffer delay information; 

determining a first lowest bit occurrence constraint based on the first time stamp 
10 information and the puffer delay information; 

determining a rirst highest bit occurrence constraint based on shifting the first 
lowest bit occurrence c&nstraint upward; 

determining a first earliest time constraint based on the first highest bit occurrence 
constraint; and 

15 determining a first latest time constraint based on the first lowest bit occurrence 

constraint. 



2. The method of claim 1 wttgrein the first lowest bit occurrence constraint increases 
substantially linearly over time. 

3. The method of claim 1 wherein\he first lowest bit occurrence constraint varies 
from increasing linearly over time to accommodate drift of the first input data stream 
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4. The method of claim 1 wherein the fii^t input data stream has a substantially 
25 constant bit rate. 

5. The method of claim 1 wherein the first in^pt data stream varies from a constant 
bit rate as influenced by drift. 

30 6. The method of claim 1 wherein the first input dafy stream has a constant frame 
rate. 
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7. The method of claim 1 wherein the first input data stream has a variable frame 
rate. \ 

8. The method of claim 1 wherein the first input data stream has a constant frame 
size. \ 

9. The method of claim 1 wherein the first input data stream has a variable frame 
size. \ 

10. The method of claim 1 wherein the first input data stream includes buffer delay 
information. \ 

1 1 . The method of claim \ wherein the first input data stream is selected from a group 
consisting of: \ 

a video stream; \ 
an audio stream; \ 
a closed caption stream; and 
a content protection data stiteam. 

12. The method of claim 1 wherem the step of determining the first highest bit 
occurrence constraint based on shifting, the first lowest bit occurrence constraint upward 
further comprises the step of: \ 

determining the first highest bit occurrence constraint based on shifting the first 
lowest bit occurrence constraint upward by\a constant amount. 

13. The method of claim 1 further comprising the steps of: 
obtaining a second input data stream; \ 

obtaining second time stamp information Kir the second input data stream; 
determining a second lowest bit occurrence constraint based on the second time 
stamp information and the buffer delay information; \ 
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determining a second highest bit occurrence constraint based on shifting the 
second lowest biuoccurrence constraint upward; 

determining a second earliest time constraint based on the second highest bit 
occurrence constraint; and 

determining asecond latest time constraint based on the second lowest bit 
occurrence constraint. 
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14. The method of claim 13 wherein the second input data stream has a second 
substantially constant bit rate 

15. The method of claim 13 fVther comprising the steps of: 
dividing the first input data Weam into a first plurality of packets; 
dividing the second input datastream into a second plurality of packets; 
combining the first plurality of jackets and the second plurality of packets to 

provide an output data stream. 



16. The method of claim 15 wherein theVtep of combining the first plurality of 
packets and the second plurality of packets to provide an output data stream further 
comprises the step of: 

20 combining the first plurality of packets anil the second plurality of packets in an 

order determined by the first earliest time constrainfvand the first latest time constraint for 
each packet of the first plurality of packets and seconM earliest time constraint and the 
second latest time constraint for each packet of the second plurality of packets. 



25 



1 7. The method of claim 1 6 wherein the first latest tinre constraint for each packet of 
the first plurality of packets is determined in relation to a fir& initial bit of each packet of 
the first plurality of packets and the second latest time constraint for each packet of the 
second plurality of packets is determined in relation to a second initial bit of each packet 
of the second plurality of packets. 
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18. The metkod of claim 17 wherein the first earliest time constraint for each packet 
of the first plurality of packets is determined in relation to a first final bit of each packet 
of the first plurality of packets and the second earliest time constraint for each packet of 
the second pluralityW packets is determined in relation to a second final bit of each 

5 packet of the second plurality of packets. 

19. The method of claim 13 further comprising the step of: 
calculating an initial current time value. 

10 20. The method of claim\l9 wherein the step of calculating an initial current time 
value comprises the step of: \ 

calculating the initial current time value by selecting a lowest value of the first 
earliest time constraint of an initial Jacket of the first plurality of packets and the second 
earliest time constraint of an initial pafcket of the second plurality of packets. 

15 \ 

21 . The method of claim 20 wherein tfte step of combining the first plurality of 
packets and the second plurality of packets to provide an output data stream comprises 
the steps of: \ 

marking as candidates the packets of the Yirst plurality of packets that have not yet 
20 been output and for which the first earliest time constraint is less than or equal to the 
current time value; \ 

marking as candidates the packets of the second plurality of packets that have not 
yet been output and for which the second earliest time constraint is less than or equal to 
the current time value. \ 
25 \ 

22. The method of claim 21 further comprising the step of: 

in the absence of candidates, combining an empty packet into the output data 
stream. \ 

30 23. The method of claim 22 further comprising the step of: \ 

calculating a new current time value based on a size of the empty packet. 
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24. The metnpd of claim 21 further comprising the step of: 

when exactly one of the candidates is marked, combining the marked candidate 
into the output strea 
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25. The method of Maim 24 further comprising the step of: 

calculating a nev^current time value based on a size of the marked candidate. 

26. The method of clairr^l further comprising the step of: 

when more than one oil the candidates is marked, selecting a selected candidate 
for which a latest time constraint of the first latest time constraint and the second latest 
time constraint is smallest. 



27. The method of claim 26 further comprising the step of: 

15 combining the selected candidate into the output data stream. 

28. The method of claim 27 further comprising the step of: 

calculating a new current time value based on a size of the selected candidate. 

20 29. The method of claim 21 further composing the step of: 

when more than one of the candidates i\ marked, randomly selecting a selected 
candidate from among the marked candidates. 

30. The method of claim 29 further comprising Yhe step of: 

25 combining the selected candidate into the ourout data stream. 

3 1 . The method of claim 30 further comprising the step of: 

calculating a new current time value based on a ske of the selected candidate. 



30 32. The method of claim 15 wherein the output data strewn is a Moving Picture 
Experts Group (MPEG) stream. 
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33. A dWta stream multiplexer receiving a plurality of input data streams and 
combining thV plurality of input data streams to provide an output data stream, the 
multiplexer comprising: 

a first inputdata stream input for receiving a first input data stream; 
a first lowest^bit occurrence constraint calculator operatively coupled to the first 
input data stream inpu\for calculating a first lowest bit occurrence constraint based on 
first time stamp information derived from the first input data stream and buffer delay 
information; 

a first highest bit occurrence constraint calculator operatively coupled to the first 
lowest bit occurrence constraint calculator for calculating a first highest bit occurrence 
constraint based on shifting the Virst lowest bit occurrence constraint upward; 

a first earliest time constraint calculator operatively coupled to the first highest bit 
occurrence constraint calculator foXcalculating a first earliest time constraint based on the 
first highest bit occurrence constraint and 

a first latest time constraint calculator operatively coupled to the first lowest bit 
occurrence constraint calculator for calculating a first latest time constraint based on the 
first lowest bit occurrence constraint. 



20 34. The data stream multiplexer of claim s3 further comprising: 

a second input data stream input for receiving a second input data stream; 
a divider operatively coupled to the first input data stream input and to the second 
input data stream input to divide the first input data stream into a first plurality of packets 
and to divide the second input data stream into a secbnd plurality of packets; 
25 a combiner coupled to the divider for combining the first plurality of packets and 

the second plurality of packets to provide an output dam stream. 
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35. The data stream multiplexer of claim 34 wherein me output data stream is a drift- 
free Moving Picture Experts Group (MPEG) program strea 
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36. A method for compensating for drift among a plurality of input streams 
comprising the steps of: 

effectively adjusting a teariiest value and a tiatest value for each packet of a plurality 
of packets ror each input stream of the plurality of input streams; and 

multiplexing the packets from the plurality of input streams according to the t ea riiest 
value and the t\ test value for each packet of the plurality of packets for each input stream 
of the plurality of input streams to provide a compensated output data stream. 

37. The method otclaim 36 wherein the relationship between the teariiest value and the 
tiatest value is determinea\based on buffer delay information. 

38. The method of claimW) wherein the plurality of input streams have substantially 
constant bit rates. \ 

39. The method of claim 38 wnerein the plurality of the streams vary from the 
substantially constant bit rates as influenced by drift. 

40. The method of claim 37 whereiAthe buffer delay information is derived from the 
plurality of input streams. \ 

41. The method of claim 36 wherein therolurality of input streams are selected from a 
group consisting of: \ 

a video stream; \ 
an audio stream; \ 
a closed caption stream; and \ 
a content protection data stream. \ 

42. The method of claim 36 wherein the compensated output data stream is a Moving 
Picture Experts Group (MPEG) stream. \ 
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43. A program storage device readable by a machine, the program storage device 
tangibly embodymg a program of instructions executable by the machine to perform steps 
for multiplexing dka streams provided as inputs to the machine, the steps comprising: 

obtaining a first input data stream; 

obtaining firsrtime stamp information for the first input data stream; 
obtaining buffer \delay information; 

determining a firsNowest bit occurrence constraint based on the first time stamp 
information and the buffer otelay information; 

determining a first hignest bit occurrence constraint based on shifting the first 
1 0 lowest bit occurrence constraint onward; 

determining a first earliest flpie constraint based on the first highest bit occurrence 
constraint; and 

determining a first latest time c^straint based on the first lowest bit occurrence 
constraint. 

15 

44. The program storage device of claim X3 wherein the step of determining the first 
highest bit occurrence constraint based on shifting the first lowest bit occurrence 
constraint upward further comprises the step of: 

determining the first highest bit occurrencAconstraint based on shifting the first 
20 lowest bit occurrence constraint upward by a constant amount. 



45. The program storage device of claim 43 furthe\comprising the steps of: 
obtaining a second input data stream; 

obtaining second time stamp information for the second input data stream; 
25 determining a second lowest bit occurrence constraint based on the second time 

stamp information and the buffer delay information; 

determining a second highest bit occurrence constrain^based on shifting the 
second lowest bit occurrence constraint upward; 

determining a second earliest time constraint based on th^second highest bit 
30 occurrence constraint; and 
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determining a second latest time constraint based on the second lowest bit 
occurrence constraint. 

46. The program storage device of claim 45 further comprising the steps of: 
dividing thA first input data stream into a first plurality of packets; 
dividing the second input data stream into a second plurality of packets; 
combining tha first plurality of packets and the second plurality of packets to 

provide an output dataWeam. 

47. The program storage device of claim 46 wherein the step of combining the first 
plurality of packets and the second plurality of packets to provide an output data stream 
further includes combining the^ first plurality of packets and the second plurality of 
packets in an order determined uw the first earliest time constraint and the first latest time 
constraint for each packet of the fust plurality of packets and second earliest time 
constraint and the second latest tim^constraint for each packet of the second plurality of 
packets. \ 

48. The program storage device of claim 45 further comprising the step of: 
calculating an initial current time vWe. 

49. The program storage device of claim 48 wherein the step of calculating an initial 
current time value includes the step of: \ 

calculating the initial current time value by selecting a lowest value of the first 
earliest time constraint of an initial packet of the fiW plurality of packets and the second 
earliest time constraint of an initial packet of the second plurality of packets. 

50. The program storage device of claim 49 whereiiMhe step of combining the first 
plurality of packets and the second plurality of packets to provide an output data stream 
comprises the steps of: \ 
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markingVs candidates the packets of the first plurality of packets that have not yet 
been output and fot which the first earliest time constraint is less than or equal to the 
current time value; 

marking as candidates the packets of the second plurality of packets that have not 
yet been output and for yhich the second earliest time constraint is less than or equal to 
the current time value. 

5 1 . The program storage device of claim 50 further comprising the step of: 

in the absence of candiatyes, combining an empty packet into the output data 

stream. 



52. The program storage device oitelaim 51 further comprising the step of: 
calculating a new current time value based on a size of the empty packet. 



15 53. The program storage device of claiiA50 further comprising the step of: 

when exactly one of the candidates is marked, combining the marked candidate 
into the output stream. 
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54. The program storage device of claim 53 fukher comprising the step of: 

calculating a new current time value based on a size of the marked candidate. 
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55. The program storage device of claim 50 further ^comprising the step of: 

when more than one of the candidates is marked, Selecting a selected candidate 
for which a latest time constraint of the first latest time constraint and the second latest 
time constraint is smallest. 



56. The program storage device of claim 55 further comprising the step of: 
combining the selected candidate into the output data strea 

30 57. The program storage device of claim 56 further comprising the step of: 

calculating a new current time value based on a size of the selected candidate. 
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58. The program storage device of claim 50 further comprising the step of: 

when more than one of the candidates is marked, randomly selecting a selected 
candidate from among the marked candidates. 

59; The program storage de^ce of claim 58 further comprising the step of: 
combining the selected can^iate into the output data stream. 



60. The program storage device of clav 
calculating a new current time vaW 



59 further comprising the step of: 
>ased on a size of the selected candidate. 
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